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(54) Subtitle coiorwiping and positioning 

(57) Coiorwiping and dynamic positioning of subti- 
tles for a video image is achieved by encoding and de- 
coding the subtitles separately from the video image. At 
the encoder (Fig. 7% subtitles are generated (55) for 
each respective video image. Coiorwiping is performed 
by changing the cotor of the subtitles at a certain location 
in the video image. At the decoder (Fig. 2), a buffer (22) 
stores the subtitles along with subtitle decoding infor- 
mation. A controller (35) precisely times a reading op- 
eration of the buffer to read out the subtitles during a 
real time display of the respective video image; and 
coiorwiping is performed by changing the color of a por- 
tion of the subtitles at a location indicated by the subtitle 
decoding information. Dynamic positioning of the subti- 
tles is achieved by delaying the time the controller exe- 
cutes the read operation. When the decoding technique 
is repeated for a number of frames, the viewer senses 
motion as the coiorwiping and positioning gradually 
changes. 
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Description 

The present invention relates to subtitles and, more 
particularly, to cotorwiptng and positioning subtitles. 

Subtitles are superimposed on a video image to s 
convey information to a viewer which supplements the 
video image. In Karaoke, for example, lyrics of songs 
are displayed on the video image as subtitles while a 
viewer sings along to an audio track of an accompanying 
video image. The subtitles also convey information to 10 
the viewer in the manner in which they are displayed. 
Highlighting the lyrics of songs in Karaoke, for example, 
cues the singer to sing, while moving the lyrics off the 
video screen indicates to the viewer to stop singing. 

Television broadcasting or video reproduction (such *s 
as from a video disk) provides subtitles for display with 
the video image. However, the subtitles are permanently 
combined with the underlying video image and can be 
manipulated only at the transmitting (or recording) end 
and not at the receiving (or reproducing) end. That is, 20 
subtitles displayed in television broadcasting or video 
reproduction are "fixed" and cannot be highlighted or 
moved at the. receiving (or reproduction) end. The sub- 
titles also cannot be turned off, which is particularly im- 
portant in Karaoke where a singer wants to test his/her 25 
singing abilities or enjoy the music video withoulthe in- 
terruption of the subtitles. 

The television broadcasting and reproduction sys- 
tems cannot adequately manipulate the subtitles at the 
transmitting (or recording) end The television broad- 30 
casting and reproduction systems require painstaking 
trial and error creation and manipulation of subtitles. In 
Karaoke, for example, where sing-aJong music videos 
are mass produced, it is desirable that each music video 
be produced quickly and effsdentty This is not possible 35 
with the television broadcasting and reproduction sys- 
tems which require slow and tedious work to custom tai- 
lor each music video. Notably, dynamic positioning in a 
fixed-type television broadcast or recording is not pos- 
sible because the subtitles are an integral part of video 40 
picture. Moving the subtitles, therefore, would leave a 
blank space where the subtitles were once superim- 
posed. 

Compact Disc Graphics (CD-G) provide more flex- 
ibility in displaying subtitles because this technique 
records graphics on a compact disc (CD) in the form of 
subcodes. However, CD-G has a serious disadvantage 
because this technique is (Med to CD applications, 
which are slow by television standards. That is, the CD- 
G technique does not tend itself to creation and manip- so 
ulatton of subtitles in real-time television broadcasts or 
video reproductions. 

CD-G is successful for computer applications be- 
cause the graphics are prog/ammedinaoVanceandthe 
large processing time required to create the graphics is ss 
largely unseen by the end user. As will be shown with 
reference to Figs. 16a-16c and 17, however, the lead 
time required to generate a fuD CD-G screen is 10.24 



seconds, which is grossly inadequate for normal televi- 
sion or video broadcasts. 

Fig. 16a depicts the CD-G data format in which one 
frame includes 1 byte of a subcode and 32 bytes of audio 
channel data. Of the 32 bytes, 24 bytes are allocated for 
L and R audio channel data (each channel having 6 
samples with 2 bytes per sample) and 8 bytes are allo- 
cated to an error correction code. The frames are 
grouped as a block of 38 frames (Frame 0, Frame 1, 
Frame 96 and Frame 97) as shown in Fig. 16b. Eight 
blocks P,Q,aS ( T,U, V and W are transmitted as shown 
in Fig. 16c. The subcodes for Frames 0 and 1 in each 
block are defined as sync patterns SO, S1 , whereas the 
remaining 96 frames store various subcode data. 
Among a group of 8 blocks, the first 2 blocks P, Q are 
allocated to search data employed for searching 
through record tracks; and graphic data can Deallocated 
to the subcodes in the remaining 6 blocks R.S.T, U, V and 
W. 

Since each block of 98 frames is transmitted at a 
repeating frequency of 75 Hz, the data transmission rate 
for 1 block is (75 x 98 bytes) 7.35 kHz, resulting in a 
subcode bit rate of 7.35 K bytes/s. The transmission for- 
mat for transmitting the information present in blocks R, 
S,T,U, Vand W is shown in Fig. 1 7. Each of the 96 frames 
(2.3,... 97) of the 6 blocks (R.S.T.U, Vand W) is arranged 
as a packet including 6 channels (R to W) of 96 symbols 
per channel. The packet is further subdivided into 4 
packs of 24 symbols each (symbol 0 to symbol 23), with 
each symbol representing a frame. 

A CD-G character is made.up of 6 x 1 2 pixels. Since 
each pack is 6 x 24, a 6 x 1 2 character is easily accom- 
modated in each pack. The CD-G format allocates the t 
six channels of (R.S.T.U.V and W) and the 12 symbols 
8 to 19 to a character. The remainder of the symbols in 
each of the packs store information about the character. 

Mode information is stored in the first 3 channels 
(R, S, T) of symbol 0 in each pack, and item information 
is stored in the last 3 channels (U, V, W) of symbol 0. A 
combination of the mode information and the item infor- 
mation defines the mode for the characters stored in the 
corresponding pack as follows: 



Tablet 


Mode 


Item 


000 


000 mode 


001 


000 graphics mode 


001 


001 TV-graphics mode 


111 


000 user's mode 



An instruction is stored in ail of the channels of sym- 
bol 1. Corresponding mode, item, parity or additional in- 
formation for the instruction is stored in all of the chan- 
nels of symbols 2 to 7. Parity for all of the data in the 
channels of symbols 0 to 19 is stored in all of the chan- 
nels of the last 4 symbols (symbols 20 to 23) of each 
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pack. 

As discussed, the data is transmitted at a repeating 
frequency of 75 Hz. Therefore, a packet which contains 
4 packs is transmitted at a rate of 300 packs per second 
(75 Hz x 4 packs). That is, with 1 character allocated to 
the range of 6 x 1 2 pixels, 300 characters can be trans- 
mitted in 1 second. 

However, a CD-G screen requires more than 300 
characters. A CD-G screen is defined as 288 horizontal 
picture elements x 1 92 vertical picture elements and re- 
quires more than twice the 300 characters transmitted 
in 1 second. The total transmission time for a 288 x 192 
screen is, therefore, 2.56 seconds as shown by the fol- 
lowing equation: 

(288/6) x (192/12) + 300 = 2.56 seconds 

This is extremely Jong to regenerate each screen 
when it is considered that screens are usually refreshed 
every 0.6 seconds. This problem is compounded when 
hexadecimal codes are used for the characters because 
each hexadecimal expression requires 4 bits to repre- 
sent 1 pixel. As a result, 4 times the data described 
above is transmitted increasing the transmission rate to 
10.24 seconds (4 x 2.56 seconds). Since each screen 
requires a sluggish 10.24 seconds for transmission, a 
continual transmission of screens means that a lag time 
of 10.24 seconds is experienced when transmitting 
screens using the CD-G technique. 

Thus, the CD-G technique is not performed in real 
time and is unacceptably slow for use in a real time 
broadcast. In generating Karaoke music videos, for ex- 
ample, it would be nearly impossible to synchronize the 
subtitles with the precise moment the lyrics are to be 
sung because the subtitles would have to be generated 
10.24 seconds in advance of the music video. 

The CD-G system also suffers from defects in re- 
producing the subtitles. The CD-G system displays sub- 
titles only upon normal reproduction and not during spe- 
cial reproduction such as a fast forward or fast reverse 
reproduction. CD-G pictures are also subject to sing 
phenomena (in which oblique portions of a character are 
ragged) or flickering because the system allocates only 
one bd of data for each picture element. The lag time of 
the COG picture also prevents switching the subtitle 
display on or off at a high speed. 

In one type of system (known as the CAPTAIN sys- 
tem), dot patterns, as well as character codes, represent 
the subtitles. This system, however, does not appear to 
be any better than the CD-G system and suffers from 
some of the same disadvantages. In both systems, for 
example, the subtitles lack refinement because these 
systems do not provide sufficient resolution power in 
displaying the subtitles. The CAPTAIN system, for ex- 
ample, is developed for a 248 (horizontal picture ele- 
ments) by 192 (vertical picture elements) display and 
not tor high resolution video pictures of 720 x 480. 



Respective aspects of the invention are set out in 
the respective independent claims hereof. 

In accordance with another aspect thereof, the in- 
vention provides a colorwiping encoding apparatus and 
5 method. A subtitle generator generates subtitles which 
are to be superimposed on a video image. The subtitles 
are encoded separately from the video image using an 
encoder. A colorwiping unit colorwipes at least a portion 
of the subtitles leaving the remaining portion in a differ- 
10 ent color. 

A colorwiping decoding method and apparatus ac- 
cording to a further aspect of the invention decodes the 
subtitles and video image encoded by the colorwiping 
encoding. A video decoder decodes the video data en- 
is coded at the encoding end. A buffer stores the subtitles 
for the video image including decoding information. A 
controller times the precise moment when the subtitles 
are to be read out from the buffer during a real time dis- 
play of said video image and a colorwiping unit causes 
20 the color of at least a portion of the subtitles to be a dif- 
ferent color than the remaining portion. 

A position decoding method and apparatus accord- 
ing to yet another aspect of the invention dynamically 
positions the subtitles in any region of the video image. 
25 a video decoder decodes video data of a video image 
to be displayed. A buffer stores the subtitles for the video 
image including decoding information. A controller times 
the precise moment when the subtitles are to be read 
out from the buffer during a real time display of said vid- 
30 60 image and a positioning unit dynamically changes 
the position where the subtitles are superimposed on 
the video image. 

A preferred form of implementation of the invention 
described herernbelow with reference to the accompa- 
35 nying drawings provides cotorwiping and dynamic posi- 
tioning of subtitles. Since the subtitles are encoded and 
decoded separately from the video image, the subtitles 
may be manipulated with great control and in real time. 
Colorwiping is achieved quickly and efficiently, allowing 
40 an operator to mass produce subtitled video pictures 
custom tailored to satisfaction. Dynamic positioning of 
the subtitles is equally as quick and efficient Applying 
the colorwiping and positioning over a period of frames, 
the end viewer is provided with the sensation of motion 
45 as the subtitles are gradually colorwiped or repositioned 
over a period of time. These and other advantages will 
be noted upon a review of the description of the pre- 
ferred form of implementation given below with refer- 
ence to the drawings. 
50 The preferred form of implementation of the inven- 
tion provides: 



a subtitle method and apparatus for colorwiping 
subtitles; 

a subtitle method and apparatus which colorwipes 
subtitles at the command of an operator and in real 
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time; 



a subtitle method and apparatus for dynamically po- 
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srtioning subtitles; and 

a subtitle method and apparatus which dynamically 
positions subtitles at the command of an operator 
and in real time. 



The invention will now be further described, by way 
of illustrative and non-jimiting example, with reference 
to the accompanying drawings, in which: 

Fig. 1 is a block diagram of a data decoding appa- 
ratus embodying the invention; 
Fig. 2 is a block diagram of a subtitle decoder de- 
picted in Fig. 1; 

Fig. 3 is a table of communications between a sys- 
tem controller of Fig. 1 and a controller of Fig. 2; 
Fig. 4 is a table of parameters for communications 
between components of Fig. 1 and Fig. 2; 
Figs. 5a to 5c are signal diagrams demonstrating 
data encoding in accordance with an embodiment 
of the invention; 

Fig. 6 is a color look up table referred to when en- 
coding subtitle data; 

Figs. 7a and 7b constitute a block diagram of en- 
coding apparatus embodying the invention; 
Figs. 8a and Bb depict a block diagram for a wipe 
data sampler of Fig. 7a; 

Fig. 9 is a color look up table referred to when con- 
ducting a color wipe operation; 
Fig. 10 is a graph for the explanation of a code buffer 
operation; 

Fig. 11 is a block diagram describing the internal 
operation of a code buffer in Fig. 2; 
Figs. 12a to 12c depict a scheme forthocoJomiping 
operation; 

Fig. 1 3 is a block diagram depicting the cobrwiping 
operation according to Figs 12a to 12c; 
Figs. 1 4a to 14c depict a scheme for a dynamic po- 
sition tng operation; 

Fig. 15 is a btockdiagram depicting the dynamic po- 
sitioning operation according to Figs. 14a to 14c; 
Figs. 16a to 16c depict the arrangement of data ac- 
cording to a CD-G format; and 
Fig. 17 depicts a transmission format of the data in 
the CD-G format 

Referring now to the drawings, wherein like refer- 
ence numerals designate identical or corresponding 
parts throughout, a preferred form of implementation of 
the invention wHI be described. 

Decoding Apparatus 



The data decoding apparatus shown in Fig. 1 which 
irtcorporates the present invention decodes a reproduc- 
tion signal. The system controller 14 of the data decod- ss Subtitle Decoder 
ing apparatus causes the reproduction signal to be proc- 
essed and sent to a subtitle decoder 7. The system con- 
trofler communicates with the controller 35 (Fig. 2) of the 



subtitle decoder to decode the subtitles and superim- 
pose them onto a decoded video image for display on 
a television screen. 

A data decoder and demult iplexer 1 receives a dig- 
s ital reproduction signal from, for example, a VCR. The 
data decoder and demultiplexer 1 error decodes the re- 
production signal preferably employing an Error Cor- 
recting Code (ECC) technique and demultiplexes the er- 
ror decoded reproduction signal into video, subtitle and 
io audio data. A memory 2 may be used, for example, as 
a buffer memory and a work area for the purpose of error 
decoding and demultiplexing the reproduction signal. 

A video decoder 3 decodes the demultiplexed video 
data from a video data stream. A memory 4 may be em- 
is ployed for the operation of decoding the video data sim- 
ilar to the operation of the memory 2 employed with data 
decoder and demultiplexer 1 . 

A letter box circuit 5 converts a video picture with a 
4:3 aspect ratio (a squeeze mode) to a 16:9 letter box 
20 ratio. The conversion is performed using a 4 to 3 deci- 
mation process, whereby every four horizontal lines are 
decimated to three horizontal lines, thus squeezing the 
video picture into a 94 picture. According to the letter box 
format, a vertical resolution component is derived from 
*5 the remaining of the video picture which is employed 
to enhance the vertical resolution of the decimated video 
picture. A timing control memory 6 ensures that the tt of 
the letter box picture is not transmitted. When the de- 
coded video data generated by the video decoder 3 is 
30 already in a 16:9 letter box formal, the letter box circuit 
bypasses the decimation operation and sends the de- 
coded video data directly to the subtitle decoder 7. 

Meanwhile, the decoded subtitle data demulti- 
plexed by the data decoder and demultiplexer 1 is di- 
ss rectly sent to the subtitle decoder 7. The subtitle decoder 
7 decodes the subtitle data according to instructions 
from the system controller 14 and mixes the decoded 
subtitle data with the decoded video data. 

A composite encoder 8 encodes the mixed subtitle 
40 data and video data into a suitable video picture format, 
such as NTSC/PAL A mode display 9 interfaces with a 
user and indicates, for example, the mode of television 
monitor connected thereto. A D/A converter 1 0 converts 
the encoded signal received from the composite ertcod- 
45 er 8 into an analog signal suitable for display in the in- 
dicated mode, such as NTSC or PAL 

The audio portion of the audio/video signal decoded 
by the data decoder and demultiplexer 1 is decoded by 
an audio decoder 11 which decodes the demultiplexed 
50 audio data using a memory 1 2, for example. The decod- 
ed audio data output from the audio decoder is convert- 
ed into an analog audio signal appropriate for broadcast 
through a television monitor by a D/A converter 13. 



The subtitle decoder 7, as will be discussed with ref- 
erence to Fig. 2, decodes the encoded subtitle data and 
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mixes the decoded subtitle data with the appropriate vid- 
eo data A controller 35 controls the operations of the 
subtitle decoder and communicates with the system 
controller 14 of the decoder (Fig. 1 ) using the command 
signals shown in Fig. 2 (as listed in Fig. 3.) Together, the s 
controller and system controller time the decoding of the 
subtitle data so that the subtitle data is mixed with video 
image data at the precise position the subtitles are to 
appear on the video image. 

The word detector 20 of the subtitle decoder 7 re- 10 
ceives the subtitle data in groups of bit streams. Each 
group of bit streams makes up one frame (or page) of 
subtitles to be superimposed on a video image. Different 
groups of streams may represent subtitles displayed in 
different playback modes, such as normal playback, '£ 
fast-reverse or fast-forward. The system controller indi- 
cates to the word detector using a stre&m_select signal 
which playback mode to display and the word detector 
selects the appropriate stream of signals for the indicat- 
ed playback mode. In the case where different video im- 20 
ages are displayed on different channels, the system 
controller indicates the appropriate channel to the word 
detector correspondingly in a ch__sefect signal and the 
word detector changes channels to receive only those 
streams on the selected channel. 25 

A group of bit streams making up one frame and 
received by the word detector include header informa- 
tion (s. header) which describes the format of the group 
of bit streams. The header information is accompanied 
with header error information (header error) and data 30 
error information (data error). The system controller us- 
es the header to determine how to parse the group of 
bit streams and extract the relevant subtitle data The 
system controller uses the header error information to 
correct anomafies in the header information and uses 35 
the data error information to correct anomalies in the 
subtitle data 

The word detector forwards the subtitle data (Bit- 
map) along with other decoding information (including 
a presentation time stamp PTS, position data 40 
pos it longdate and color took up table data 
CLUTjtata) to the code detector 22. The PTS is a sig- 
nal that indicates the length of time the subtitles are to 
be displayed The position data indicates the horizontal 
and vertical position where the subtitles are to be super- 4S 
imposed on the video image. The CLUT_data indicates 
which colors are to be used for the pixels making up the 
subtitles. For example, the system controller determines 
that a video image is behg displayed and causes the 
code buffer to output the corresponding subtitle data so 
(Bitmap) at a position in the video image represented 
by the horizontal and vertical position indicated by the 
posrtton_data, in the color indicated by the CLUT_data 
and for a period of time indicated by the PTS. 

A scheduler 21 is provided to ensure that the data ss 
received from the demultiplexer 1 (Rg. 1 ) does not over- 
flow the code buffer 22. The scheduler controls read/ 
write access to the code buffer by determining a band- 



width for an I/O port (not shown) which receives the bit 
streams selected by the word detector. The bandwidth 
refers to the number of parallel bits supplied to the I/O 
port at one time and is calculated by dividing the rate at 
which the demultiplexer demultiplexes data by the rate 
at which data is read from the code buffer. For example, 
a data rate from the demultiplexer of 20 Mbps divided 
by a 2.5 Mbps rate of data read from the code buffer is 
equal to 8 bits. Therefore, the scheduler will set the I/O 
port to receive 8 bits in parallel in order to maintain a 
consistent flow rate of data into and out of the code buff- 
er. The code buffer, thus, receives the subtitle data (Bit- 
map) and awaits a decode start signal from the system 
controller to read out the data. 

The system controller executes reading in real time 
when it is determined from the horizontal and vertical 
sync signals that the television scanner is at a position 
corresponding to the position indicated by the 
position_data For real time display, the reading rate 
should correspond to a picture element sampling rate, 
preferably 13.5 MHz. As discussed, the subtitle data 
preferably is written into the code buffer at a rate of 2.5 
MHz or more. Thusrthe 13.5 MHz sampling clock is di- 
vided into four clock cycles of 3.375 MHz each. One of 
these 3.375 MHz clock cycles is allocated to writing (be- 
cause writing requires at least 2.5 MHz) and the remain- 
ing three clock cycles are allocated to reading data from 
the code buffer, thus satisfying the requirement for real 
time display. 

The read/write operation described is not only per- 
formed in real time, but also provides high resolution. 
Eight bits of the subtitle data are read from the code buff- 
er 22 for each of three clock cycles, or twenty-four bits 
per sampling clock. When display of the picture is con- 
ducted by the television monitor every fourth clock cycle, 
one-fourth of the twenty-four bits, (24/4 =) 6 bits are dis- 
played at every clock cycle. That is, each subtitle picture 
element may comprise six bits, which is more than suf- 
ficient to achieve a high quality of resolution for the sub- 
titles. 

The operation of the code buffer 22 and correspond- 
ing components of Fig. 2 is depicted as a block diagram 
in Fig. 1 1 . The code buffer 22-1 accumulates streams of 
subtitle data until at least one page of subtitle data is 
accumulated in the code buffer. The subtitle data for one 
page is transferred from the code buffer 22-1 to the dis- 
play memory 22 2 (which acts as a buffer for the subtitle 
decoder) when the display time stamp (PTS) is aligned 
with the synchronizing clock (SCR). The synchronizing 
clock advances a pointer in the display memory 22-2 
during readrcg indicating which address of subtitle data 
is being currently read. It will be noted that placing the 
code buffer and display memory in a single unit is pre- 
ferred since the code buffer need only increment one 
pointer pointing to the current address in the display 
memory 22-2 which stores the next set of subtitle data. 
Thus, no delay is caused due to a transfer, resulting in 
a high speed transfer of the subtitle data 
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When the code buffer is read during a normal play- 
back mode, the synchronizing clock advances the point- 
er of the display memory 22-2 at each pulse. However, 
during special reproduction (such as fast-forward, fast- 
reverse playback modes), the pointer must be advanced 
at a different rate. A special command is first sent to the 
controller 35 and the controller sends back an acknowl- 
edge signal (speclal_ack), acknowledging that special 
reproduction is to be initiated. To uniformly speed up (or 
slow down) the operations of the subtitle decoder ac- 
cording to the special reproduction rate, the system 
clock reference (SCR) can be altered by adding or sub- 
tracting clock pulses. Subtraction pulses are created at 
an n times rate corresponding to the rate of fast-feeding 
or fast-reverse feeding. For example, at the time when 
special reproduction is commenced, real time subtrac- 
tion is performed on the bit stream of subtitle data read 
out from the code buffer at then times rate and the point- 
er advances at the desired rate to effect the special play- 
back mode. 

When the special reproduction operation corre- 
sponds-to a pause operation, on the other hand, no sub- 
traction pulses are created. Instead, an identical frame 
is continuously read from the code buffer repeatedly, 
thus providing the sensation illusion that the subtitles 
are paused. 

The reading operation is ended when the subtitle 
decoder 7 determines that an end of page (EOP) of the 
subtitle frame is reached. -The system controller 14 
sends a repeat time signal to the controller 35 which 
indicates the length of a page. An inverse run-length cir- 
cuit 24 includes a counter and sends a display end sig- 
nal to the controller 35 when the count value of the coun- 
ter reaches the value indicated by the repeat time sig- 
nal. When the controller 35 determines that the repeat 
time is reached, the reading operation of the code buffer 
is stopped. The code buffer preferably stores at least 
two pages of subtitle data because one page will be read 
as another page is written into the code buffer. 

The controller 35 issues a buffer overflew signal 
to the system controller 1 4 when an overflow of the code 
buffer occurs. An overflow can be determined when the 
controller receives the display end signal from the run- 
length circuit 24 before the word detector 20 receives 
an end of page (EOP) signal on the following page. At 
that time, the system controller 14 withholds transfer of 
subtitle data from the data decoder and demultiplexer 1 
(Fig. 1) to the word detector to prevent an overflow of 
the code buffer. When an overflow condition has 
passed, the next stream will be written into the code buff- 
er and displayed at the correct display start position. 

An underflow condition exists when the code buffer 
has completed reading the subtitle data for an entire 
page and no further data exists in the code buffer. A 
code buffer with a capacity of two pages is depicted by 
the 'code buffer size* line in Fig. 10. Graphically, an un- 
derflow would appear in Rg. 10 as one of the vertical 
portions of line (C) which extends below the lower limit 
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of the code buffer. By contrast, an overflow condition is 
graphically depicted in Fig. 10 when the subtitle data 
read into the code buffer is too large, i.e., the horizontal 
portion of line (C) extends beyond line (B). 

Fig. 10 graphically demonstrates the data flow into 
and out of the code buffer 22. The T-axis (abscissa) rep- 
resents time, while the D-axis (ordinate) represents data 
size for each page of data Thus, the gradient (rise/run) 
represents the data flow rate of the subtitles into the 
code buffer. Graph (C) represents the data flow of the 
subtitle data The vertical portions of graph (C) indicate 
a transfer of subtitle data from the code buffer when the 
display time stamp (PTS) is aligned with the synchro- 
nizing clock (SCR) generated internally by the subtitle 
decoder 7. The horizontal portions of the graph (C) in- 
dicate the transfer of subtitle data into the code buffer. 
For example, at a time that the display time stamp (PTS) 
for page (SO) is received by the code buffer, the previous 
page of subtitle data is transferred from the code buffer 
and page (SO) is written into the code buffer When an- 
other display time stamp (PTS) is received by the code 
buffer, the subtitle data of page (SO) is transferred out 
of the code buffer and page (S1 ) is written in. Similarly, 
the remaining pages (S2), (S3) are written hto and read 
out of the code buffer as indicated. 

To precisely time the reading of the subtitle data 
from the code buffer with the display of the video image, 
delay compensation must be performed to allow for de- 
lays within the subtitle decoder. This is especially impor- 
tant where an external memory is employed as the dis- 
play memory because an external memory increases 
the delay factor. Delay compensation is achieved by 
controlling the timing of the decode start command 
from the system controller 14. The system controller 14 
delays the decode start command by a time equal to 
the processing of a tetter box picture (approximately one 
field) and a delay caused by video decoding at the in- 
stant the synchronizing clock of the controller (SCR) is 
aligned with the display time stamp (PTS). Delay com- 
pensation is particularly useful, since the video, audio 
and subtitle data are multiplexed on the premise that the 
decode delay in each of the video, audio and subtitle 
data signals is zero in the data encoding apparatus. 

When the subtitle data for one page is read out of 
the display memory 22-2 (Fig. 11), the headers of the 
bit streams are separated therefrom by a parser 22-3 
and forwarded to the inverse variable-length coder or 
run-length decoder 23. 24 during a vertical blanking pe- 
riod (V). The inverse VLC (variable Length Coding) cir- 
cuit 23 (Fig. 2) subjects the subtitle data to variable 
length decoding. The variable length decoded subtitle 
data is composed of level data p ■ or "0*) and run data 
as paired data. In the case were variable length decod- 
ing is not employed, the inverse VLC circuit may be by- 
passed and the subtitle data read from the code buffer 
will be directly output to the inverse run-length circuit 24. 
The inverse run-length circuit 24 conducts run-length 
decoding by generating the level of data from the 
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number of run data elements. Thus, the VLC circuit 23 
and the run-length circuit 24 decompress the subtitle da- 
ta which had been stored as compressed data in the 
code buffer 22. 

The decompressed subtitle data is then sent to a a s 
4 fitter 25. The 3:4 filter receives an xsqueeze signal 
from the system controller 1 4 indicating the aspect ratio 
of the corresponding television monitor. Where the sig- 
nal indicates that the monitor has a 4:3 aspect ratio, the 
3:4 fitter applies 3:4 filtration processing to the subtitle io 
data to match the size of the subtitles to the size of the 
video picture. There are no Fig. 11 . In the preferred em- 
bodiment, the controller 35 reads 90 pixels worth of sub- 
title data from the code buffer 22 before the H sync pulse 
is generated. In the case where the television monitor is 
already has a 16:9 aspect ratio, or the decompressed 
subtitle data represents fonts, the 3.4 filter is bypassed 
as shown in Fig. 11. 

A color look-up table 26 (CLUT) receives the subti- 
tle data from the 3:4 filter 25 and the CLUT_data from 
the code buffer 22. The color look up table generates a 
suitable color from the CLUTjdata for the subtitle data 
The color look up table selects an address correspond- 
ing to the subtitle data for each pixel and forwards a mix- 
ing ratio K and color components Y (luminance), Cr 2S 
(color difference signal R-Y) and Cg (color difference 
signal B-Y) to the mixer 34. The color components Y, C„ 
and Cg, when mixed by the mixer, at the mixing ratio K 
create a pixel with the color indicated by the color look 
up table. 30 

Background video data is incorporated in the ar- 
rangement of the color look-up table. For example, ad- 
dress 0 of the look-up table includes key data K having 
the value of 00 h; which means that the subtitle data will 
not be seen and the background video data will many- 3S 
fest, as shown by regions T1 and T5 in Fig. 5c. Address- 
es 1h to 6h of the look-up table include values of the key 
data K which increase linearly (20, 40 ... CO hexadeci- 
mal); which means that the subtitle pixels according to 
these addresses aro mixed with the background data as 40 
shown by the regions T2 and T4 in Fig. 5c Finally, ad- 
dresses 8h to Fh of the look-up table include values of 
key data K of EOh; which means that the components 
Y, Cr and Cb are mixed without any background video 
data as shown by region T3 in Fig. 5c. The color look- 45 
up table data is generated from the system controller 
and is previously downloaded to the CLUT circuit before 
decoding. With the color look-up table, the filtered sub- 
title data is transformed into the appropriate color pixel 
for display on the television monitor. so 

Fig. 6 shows an example of a color look-up table 
where the components Y, Cr, Cb and K are arranged 
according to the addresses 0...F (hexadecimal). As will 
be explained, color wiping is performed by changing the 
CLUTjfata, thereby replacing part of the color look up ss 
table by the color wiping color look up table, shown in 
Rg. 9. Normally, a particular subtitle frame is refreshed 
several times because frames are refreshed on a tele- 



vision several times a second. When the subtitles are 
refreshed, the same subtitle data will be employed. 
However, the color will be different due to the changed 
color look up table. Thus, the subtitles will appear to be 
color wiped as they are refreshed with each consecutive 
frame. 

A mixer 34 (Fig. 2) mixes the pixels from the color 
look-up table 26 with video data from the video decoder 
3 (Fig. 1). The resulting mixed data represents a video 
picture with superimposed subtitles and is ready to be 
output to a television monitor. The mixer 34 is controlled 
to position the subtitles within the video picture. The sys- 
tem controller 14 sends a opposition signal generated 
by the commands of an operator to the mixer via con- 
troller 35 which designates the vertical position for dis- 
play on the screen. The opposition value may be varied 
(either by a user, the transmitter, or otherwise) allowing 
a user to place the subtitles anywhere along a vertical 
axis. 

A decoding apparatus embodying the invention 
may be practiced with the parameters for the different 
signals shown in Fig. 4. However, the present invention 
is not limited to the parameters set forth in that figure 
and may be employed in different video systems. 

With the present apparatus, a viewer has control 
over the display of the subtitle through the mode display 
device 9. The system controller 14. upon command from 
the user, sends a control signal to the mixer 34 (Fig. 2), 
turning the subtitles on or off. Since the present appa- 
ratus decodes subtitles in real time, the user does not 
experience any unpleasant delay when turning the sub- 
titles on or off . In addition, the subtitles can be controlled, 
by the user or otherwise, to fade-in/fade out at a variable 
rate. This is achieved by multiplying a fade coefficient 
to the pattern data representing the subtitles at a desig- 
nated speed. This function also allows an editor of the 
subtitles to present viewers with different sensations ac- 
cording to the broadcast of the audio/video picture. For 
example, news information may be flashed" rapidly to 
draw the attention of the viewer, whereas subtitles in a 
slow music video 'softly^ appear in order not to detract 
from the enjoyment of the music video. 

Encoding Technique 

The encoding technique employed in the preferred 
form of implementation of the invention will be descrtoed 
in more particular detail with reference to Figs. 5a, 5b 
and 5c and Fig. 6. As an example, the technique for en- 
coding the letter 'A* of Fig. 5a will be explained. The 
letter "A* is scanned along successive horizontal lines 
and the fill data of Fig. 5b is generated for the letter "A* 
along each horizontal line. It will be noted that the level 
'E0" demarks the highest level for recreating a color pix- 
el from the color look-up table shown in Fig. 6. whereas 
level *0 m represents a lack of subtitle data 

The key data (K) (or mixing ratio) determines the 
degree to which the fill data is mixed with background 
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video. Regions T1 and T5 of the key data correspond to 
areas in the video picture that are not superimposed with 
the fill data; therefore, these areas are designated as 
level 0 as indicated by address 0 in Fig. 6. Regions T2 
and T4 are mixed areas where the subtitles are gradu- 
ally mixed with the background video picture so that the 
subtitles blend into the background video picture and do 
not abruptly contrast therewith. Any of the mi data in this 
area is stored in addresses 1 through 6 of the color look 
up table. The main portion of the letter "A" is displayed 
within the T3 region where the background information 
is muted. The subtitle information in region T3 is stored 
as addresses 7 to F (hexadecimal). The color look-up 
table of Fig. 6 is arranged in varying degrees of the lu- 
minance component Y. When a pixel in the region T3 is 
to be stored, for example, and the level ol the luminance 
component Y for that particular pixel is 20 (hexadeci- 
mal), the color information for that pixel is obtained from 
address 9. In this manner, the remaining pixels for the 
subtitle characters are encoded. 



Encoding Apparatus \ 

Encoding apparatus embodying the invention is de- 
picted in Figs. 7a, b. Audio and video information is re- 
ceived by a microphone 53 and video camera 51, re- 
spectively and forwarded to a multiplexer 58. The sub- 
title data are entered through either a character gener- 
ator 55 or a flying spot scanner 56 and encoded by a 
subtitle encoding circuit 57. The encoded subtitle infor- 
mation is sent to the multiplexer 58 and combined with 
the audkvvkteo information onto a record disc 91 or 
channel for transmission, cfispby, recording or the like. 

The video camera 51 generates the video signal 
and supplies the same to a video encoding unit 52 which 
converts the video signal from analog to digital form. Th e 
digitized video signal is then compressed for video 
transmission and forwarded to a rate controller 52a, 
which controls the rate that the compressed video data 
Is transferred to the multiplexer in synchronism with the 
rate that the subtitles are sent to the multiplexer. In this 
manner, the compressed video data is combined with 
the subtitle data at the correct time. Similarly, audio in- 
formation is obtained by the microphone 53 and encod- 
ed by an audio encoding unit 54 before being sent to the 
multiplexer. The audio encoding unit does not necessar- 
ily include a rate controller because the audio data may 
ultimately be recorded on a different track or transmitted 
over a different channel from the video data. 

The subtitles are generated by either character gen- 
erator 55 or flying spot scanner 56. The character gen- 
erator includes a monitor and a keyboard which allows 
an operator to manually insert subtitles into a video pic- 
ture. The operator edits the subtitles by typing the sub- 
titles through the keyboard The flying spot scanner 56, 
on the other hand, is provided in the situation where sub- 
titles are already provided in an external video picture. 
The frying spot scanner scans the video picture and de- 



termines where the subtitles are positioned and gener- 
ates corresponding subtitle data therefrom. The subti- 
tles from the flying spot scanner are pre-processed by 
the processing circuit 63 to conform with subtitles gen- 
s erated by the character generator and forwarded to the 
subtitle encoding circuit. 

The subtitle data from either the character genera- 
tor 55 or the flying spot scanner are then selected for 
compression. The character generator outputs blanking 
10 data, subtitle data and key data The subtitle data and 
key data are forwarded to a switch 61 which is switched 
according to a predetermined timing to select either the 
subtitle or key data. The selected data from switch 81 is 
filtered by a filter 72 and supplied to another switch 62. 
is Switch 62 switches between the blanking data, the fil- 
tered data from the character generator and the proc- 
essed data from the flying spot scanner. When it is de- 
termined that no subtitles are present, the blanking data 
is chosen by the switch 62. Where subtitles are present, 
^0 the switch 62 chooses between the character generator 
data or the flying spot scanner data, depending upon 
which device is being used to generate the subtitle data 
The data selected by switch 62 is then quantized by 
a quantization circuit 64, using a quantization based on 
& datafedbackfromasubtitlebufferverifier68. Thequan- 
tized data, which may be compressed, is supplied to a 
switch 69 and (during normal operation) forwarded to a 
differential pulse code modulation (DPCM) circuit 65 for 
pulse code modulation. The modulated data is run- 
30 length encoded by a run-length coding circuit 66 and 
variable-length encoded by a variable-length encoding 
circuit 67 and forwarded to the subtitle buffer verifier 68 
for final processing before being sent to the multiplexer 
58. 

as The subtitle buffer verifier 68 verifies that the buffer 
is sufficiently filled with data without overflowing. This is 
done by feeding a control signal (referred to in Fig. 7A 
as a filter signal) back to the quantization circuit 64. The 
control signal changes the quantization level of the 
quantization circuit, thereby changing the amount of da- 
ta encoded for a particular subtitle. By increasing the 
quantization level, the amount of data required for the 
subtitle data is reduced and the bit rate of data flowing 
to the subtitle buffer verifier is consequently reduced. 
45 When the subtitle buffer verifier determines that there is 
an underflow of data, the control signal decreases the 
quantization level and the amount of data output from 
the quantization circuit increases, thereby filling the sub- 
tit le buffer verifier. 
so The subtitle buffer verifier is also responsible for 
preparing the subtitle data for transmission (over televi- 
sion airwaves, for example). The subtitle buffer verifier 
inserts information necessary to decode the encoded 
subtitle data This information includes a normal/spe- 
ss clal play signal which indicates whether the subtitles . 
are recorded in a normal or special (fast-forward/re- 
verse) mode. An upper limit value signal is inserted 
which indicates the upper limit for the memory size of 
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the subtitle data for a frame. An EOP signal marks the 
end of page for the subtitle data frame and also is in- 
serted. A time code signal is inserted which is used as 
the time stamp PTS in decoding. Subtitle encoding In- 
formation is inserted and includes information used in 
encoding the subtitle data, such as the quantization fac- 
tor. Positional Information is inserted and is used as 
the pos It longdate upon decoding. A static/dynamic 
signal is inserted which indicates whether the subtitle 
data is in static or dynamic mode. The subtitle buffer ver- 
ifier also inserts the color look up table address for trans- 
mission to the decoder so that the colors of the display 
will match the colors employed in creating the subtitles. 

The subtitle buff er verifier is preferably a code buffer 
similar to the code buffer 22 of the decoder (Fig.2). To 
that end. it is useful to think of the operation of the sub- 
title buffer verifier to be in symmetry (i.e. , performing the 
inverse functions of the code buffer) with the code buffer 
operational diagram of Fig. 11. For example, the color 
pixels of the subtitles are converted into digital repre- 
sentations; the digital subtitles are encoded by a run 
length encoder and a variable length encoder; header 
information is added; and the resultant subtitle informa- 
tion is stored in a buffer and forwarded to a multiplexer 
for multiplexing with the audio and video data 

The multiplexer 58 multiplexes the encoded subtitle 
data with the video and audio data, preferably employ- 
ing a time-sliced multiplexing encoding unit The multi- 
plexer also provides error correction processing (e.g., 
error correction coding) and modulation processing (e. 
g.. EFM, eight-to-fourteen modulation). The multiplexed 
data is then transmitted (via television broadcasting, re- 
cording, or other means of transference) to the decoding 
apparatus for decoding and display. 

Colorwiping Encoding 

Cotorwiping refers to a process by which an image, 
such as the subtitles, is gradually overlay ed with another 
image. An exemplary application of cofaxwiping is high- 
lighting, wherein a frame of subtitles is dynamically high- 
lighted from left to right with the passage of time. High- 
fighting is particularly useful in, for example, Karaoke 
where the displayed lyrics are highlighted from left to 
right as the lyrics are sung. The preferred form of imple- 
mentation of the invention performs colorwiping by 
changing the color look up table at different points of the 
subtitle display. For example, an initial subtitle frame is 
generated with the standard color look up table in Fig. 
6. When colorwiping is performed, the color look up ta- 
ble is changed from the colorwiping to the standard color 
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ing color dynarnicafly over time from left to right 

An encoding operation for color wiping will now be 
discussed with reference to Figs. 7a, 8a and 6b. During 
the course of encoding subtitles, an operator may desire 
to color wipe the previously encoded subtitles. To that 
end, the operator is provided with a wqpe lever 81 tocon- 
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trol the colorwiping and a monitor 84 to view the color 
wiping in real time. The wipe lever is connected to an 
adapter 82 toadapt the analog voltages of the wipe lever 
to digital impulses suitable for digital manipulation. The 
digital output of the adapter is fed to both a switcher 83 
and a wipe data sampler 70. The switcher switches the 
color look up table to values represented by the position 
of the wipe lever and generates color pixels of the sub- 
titles for display on the monitor. Thus, the operator can 
visually inspect the colorwiping procedure while it oc- 
curs and adjust the speed or color of the wiping to sat- 
isfaction. 

The wipe data sampler and position sampler 70 de- 
termines from the adapter signals where in the video pic- 
ture the color look up table is to be changed and outputs 
this information to the encoding circuits 65, 66 and 67 
(via switch 69) for encoding and transmission to the mul- 
tiplexer 58. Figs. 8a and 8b depict a block diagram of 
the operation of the wipe data and position sampler. A 
comparator compares a present pixel signal generated 
by the adapter with a previous pixel signal from the 
adapter. This is achieved by transmitting th e present pix- 
el value to input A of a comparator 301 while supplying 
the previous pixel value latched in a register 300 to input 
B of the comparator 301. The comparator outputs a 
boolean "true* value to a counter 302 (which is reset at 
every horizontal or vertical sync pulse) when the present 
and previous pixels have the same value and the coun- 
ter increments a count value. That is, the comparator 
registers a true condition when the pixels up until that 
point are generated from the same color look up table. 
At the point where the color look up table changes, 
therefore, the present and previous pixels become un- 
equal (i.e., their color changes) and the comparator gen- 
erates a false' boolean condition. The count value, 
thus, is equal to the number of matches between the 
present and previous values, which is the same as the 
position at which the color look up table changes. The 
count value is latched by a register 303 upon the follow- 
ing vertical sync pulse and transferred to the encoding 
circuits (via switch 69) for transmission. 

Colorwiping Decoding 

Color wiping decoding will now be discussed with 
reference to Figs. 1 2a-c and 1 3. Fig. 12a shows the po- 
sition where the color look up table is switched at point 
A from a color wiping look up table (Fig. 9) to the stand- 
ard color look up table (Fig. 6). Fig. 1 2b depicts a pattern 
of subtitle and colorwipe data arranged in discrete 
blocks of presentation time stamps (PTS(n)... PTS 
(n+t)). The first presentation time stamp P7S(n) corre- 
sponds to normal subtitle data and the remaining pres- 
entation time stamps PT5(n+1 ... n+t) correspond to 
colorwiping data (WPA... WPZ). Fig. 12c shows suc- 
cessive frames (n ... n+t) which correspond to the pres- 
entation time stamps. To execute colorwiping, each suc- 
cessive colorwiping frame (WPA ... WPZ) sets the point 
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where th e color look up table is switched (point A) further 
along the displayed subtitle, thereby dynamically per- 
forming colorwiping as a function of time. 

An operational block diagram of the colorwiping de- 
coding is depicted in Fig. 1 3. The vertical sync pulse trig- s 
gers a register 205 to latch the current subtitle frame 
(Fig. 1 3 shows a colorwiping frame WP being latched). 
The colorwiping data latched by the register indicates 
the position of the color look up table switching. A pixel 
counter decrements the value indicated by the cotorwip- 10 
ing data at each horizontal sync pulse and outputs a 
boolean true" Hag to the color look up table 26. While 
the flag is "true" the color look up table employs the 
colorwiping table (Fig. 9) to decode the colors of the sub- 
title pixels. When the pixel counter reaches zero, the po- is 
sition of color look table switching is reached and the 
pixel counter issues a boolean "false" flag to the color 
look up table 26. At this time, the color look up table 
switches the colorwiping color took up table (Fig. 9) to 
the standard look up table (Fig. 6), and the remainder 20 
of the subtitle frame is displayed in standard color mode. 
Each successive colorwiping frame (WRA... WPZ) 
moves the position of switching; thus, each refreshed 
subtitle frame advances (or retreats) the colorwping, 
thus performing dynamic colorwiping. 2s 

The colorwiping color took up table in Fig. 9 incor- 
porates two sets of colors (one set for addresses Oh to 
7h and a second set for addresses 8h to Fh). Thus, the 
cotorwip trig color can be changed to a secondary color 
simply by changing the most significant bit (MSB) of the & 
color look up table address. For example, the first set of 
colorwiping colors has a MSB of "0", while the second 
set has a MSB of "1". Changing the MSB of address 7h 
to a "1 ' transforms the address to Fh and the colorwiping 
color changes. This may be done, for example, by set- 55 
ting the MSB equal to the flag of pixel counter 208. 

Employing the MSB to change between color sets 
has the advantage of reducing the number of bits re- 
quired to be encoded. Since the MSB is known, only the 
three lower order bits need to be encoded where 4 bits AO 
are employed for every pixel Where two bits are em- 
ployed for every pixel, the subtitle data is coded only for 
the least significant biL In a 4 bits per 2 pixel format, only 
the MSB is employed fwcokx control and the remaining 
three bits can be reserved for pixel information. Thus, as 
by using the MSB the number of bits encoded can be 
decreased and the overall processing time for encoding 
and decoding is optimized. 

Dynamic Subtitle Positioning so 

The subtitles are repositioned dynamically, Le., as 
a function of time, by employing a similar technique as 
described above with reference to colorwiping. As 
shown in Figs. 14a-c, the position data is measured ss 
along the horizontal axis (Rg. 14a) and is transferred to 
the subtitle decoder with the subtitle data during the ap- 
propriate frame (Fig. 14c) conesporafing to a presenta- 



tion time stamp (PTS(n), for example; Fig. 14b). 

The positioning operation will now be explained with 
reference to Fig. 1 5. The position data is a value repre- 
senting the position of the subtitle frame along the hor- 
izontal axis and is read out from the display buffer and 
latched by register 205 on each vertical sync pulse. Pixel 
counter 208 decrements the position data on each hor- 
izontal sync pulse and send a boolean flag to the con- 
troller 35 (Figs. 2 and 15) to indicate that the position of 
the subtitle frame has not been reached. When the pixel 
counter reaches zero, the position of the subtitle frame 
has been reached and the boolean flag is toggled to in- 
dicate this to the controller. The controller, which has 
been delaying the reading operation of the code buffer 
22 (Fig. 2), then causes the code buffer to read out the 
subtitle data to the run length decoder 24 (Fig. 2). The 
subtitle data is then decoded as described above and 
displayed with the corresponding video image. In this 
manner, the position of the subtitle frame is changed 
with each frame; thus providing dynamic movement of 
the subtitle frame. 

The preferred form of implementation of the inven- 
tion thus provides subtitle colorwiping and dynamic po- 
sitioning. Since the subtitles are encoded and decoded 
in real time separately from the audio/video data, the 
subtitles can be controlled with great flexibility In Kara- 
oke, for example, the subtitles may be turned off at any 
time and instantaneously when it is desired to test the 
singer's skill in singing the song. Colorwiping and dy- 
namic positioning of the subtitles is also performed in 
real time, allowing an operator to quickly and easily pro- 
duce video pictures in mass. Moreover, the results of 
colorwiping and dynamic positioning may be instantly 
viewed by an operator and adjusted to satisfaction, pro- 
viding custom tailoring of each audio/video picture. 

It will be appreciated that the present invention is 
applicable to other applications, such as television or 
video graphics. It is, therefore, to be understood that, 
within the scope of the appended claims, the invention 
may be practiced otherwise than as specifically de- 
scribed herein. 



Claims 

1 . A subtitle colorwiping encoding apparatus compris- 
ing: 

subtitle generating means for generating a 
frame of subtitles for a respective video image; 
encoding means for encoding said subtitles into 
encoded subtitle data and for separately en- 
coding said video image into encoded video da- 
ta; and 

colorwiping means for causing at least a portion 
of said frame of subtitles to have a different 
color than other portions of said frame of sub- 
titles. 
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2. The subtitle coiorwiping encoding apparatus of 
claim 1, further comprising color look up table 
means for encoding each pixel of said subtitles as 
an address in a standard color look up table, said 
address being chosen according to color compo- s 
nents of that pixel. 

3. The subtitle coiorwiping encoding apparatus of 
claim 2, wherein the coiorwiping means comprises 
wipe data sampler means for indicating a location 10 
along said subtitles in said frame where said stand- 
ard color look up table is to be replaced with a color- 
wiping color look up table, causing said portion of 
said frame encoded after said location to have a dif- 
ferent color than said frame encoded before said is 
location. 

4. The subtitle coiorwiping encoding apparatus of 
claim 3, wherein the colo/wiping means further 
comprises: 20 

latch means for latching addresses generated 
by the color look up table means for each pixel 
in said frame of subtitles; 

comparator means for making a comparison 25 
between a present address generated by the 
color look up table means and a previous ad- 
dress latched by said latch means; 
counter means for keeping a count value of 
each comparison by said comparator means 30 
while said comparison results in a finding of 
equality between the present and previous ad- 
dresses, indicating that said frame is color- 
wiped until an unequal comparison is made; 
and 35 
register means for latching said count value 
when said comparison yields an unequal result. 

5. The subtitle coiorwiping encoding apparatus of 
claim 4, wherein the coiorwiping means further *o 
comprises: 

a coiorwiping selector manually operated and 
representing a position along said frame indi- 
cating where coiorwiping ends; and 45 
a monitor for displaying said coiorwiping as a 
function of said coiorwiping selector. 

6L The subtitle coiorwiping encoding apparatus of 
claim 5, wherein said coiorwiping is performed in so 
real time as a video picture composed of several 
video images is displayed continuously on said 
monitor 

7. A subtit te coiorwiping encoding method comprising ss 
the steps of: 

generating a frame of subtitles for a respective 



video image; 

encoding said subtitles into encoded subtitle 
data and separately encoding said video image 
into encoded video data; and 
coiorwiping at least a portion of said frame of 
subtitles causing said portion to have a different 
color than other portions of said frame of sub- 
titles. 

8. The subtitle coiorwiping encoding method of claim 

7, further comprising the step of: 
encoding each pixel of said subtitles as an ad- 
dress in a standard color look up table, said address 
being chosen according to color components of that 
pixel. 

9. The subtitle coiorwiping encoding method of claim 

8, wherein the step of coiorwiping comprises indi- 
cating a location along said subtitles in said frame 
where said standard color look up table is to be re- 
placed with a coiorwiping color look up table, and 
causing said portion of said frame encoded after 
said location to have a different color than said 
frame encoded before said point. 

10. The subtitle coiorwiping encoding method of claim 

9, wherein the step of cobrwiprng further comprises 
the steps of: 

latching addresses for each pixel generated by 
encoding each pixel in said frame of subtitles; 
making a comparison between a present ad- 
dress generated by encoding each pixel and a 
previously latched address; 
counting a count value of each comparison 
while said comparison results in a finding of 
equality between the present and previous ad- 
dresses, indicating that said frame is color- 
wiped until an unequal comparison is made; 
and 

latching said count value when said compari- 
son yields an unequal result 

11. The subtitle coiorwiping encoding method of claim 

1 0, wherein the step of coiorwiping further compris- 
es the steps of: 

manually adjusting a coiorwiping selector to 
represent a position along said frame indicating 
where coiorwiping ends; and 
displaying on a monitor said coiorwiping as a 
function of said coiorwiping selector. 

12. The subtitle coiorwiping encoding method of claim 

11, wherein said step of coiorwiping step is per- 
formed in real time as a video picture composed of 
several video images is displayed continuously on 
said monitor. 
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13. A subtitle cotorwiping decoding apparatus supplied 
with multiplexed subtitle data and encoded video 
data, comprising: 

video decoding means for decoding the encod- s 
ed video data of a video image to be displayed; 
buffer means for storing the subtitle data includ- 
ing decoding information to be displayed as a 
frame of subtitles contemporaneously with said 
video image; w 
control means for timing a read out operation 
of said subtitle data out from said buffer means 
during a real time display of said video image; 
and 

cotorwiping means for changing a color of at '5 
least a portion of said frame of subtitles at a lo- 
cation indicated by said decoding information. 

14. The subtitle cotorwiping decoding apparatus of 
claim 13 further comprising delay compensation 20 
means for compensating a delay caused by com- 
ponents of the cotorwiping decoding apparatus 
such that sad frame of subtitles is displayed with 
said video image at a position indicated by said de- 
coding information. 2S 



means for decoding said subtitle data stored in said 
buffer means. 

19. The subtitle cotorwiping decoding apparatus of 
claim 18 further comprising mixing means for mix- 
ing said video data decoded by said video decoding 
means with said subtitle data decoded by said sub- 
title decoding means. 

20. A subtitle cotorwiping decoding method for decod- 
ing subtitle data multiplexed with encoded video da- 
ta comprising the steps of: 

video decoding the encoded video data of a vid- 
eo image to be displayed; 
storing in a buffer the subtitle data, including de- 
coding information, to be displayed as a frame 
of subtitles contemporaneously with said video 
image; 

controlling the timing of a read out operation of 
said subtitle data out from said buffer during a 
real time display of said video image; and 
cotorwiping for changing a color of at least a 
portion of said frame of subtitles at a location 
indicated by said decoding information. 



15. The subtitle cotorwiping decoding apparatus of 
claim 13 further comprising color look up table 
means tor representing each pixel of said subtitles 
as an address in a standard color look up table, said 
address being chosen according to color compo- 
nents of each pixel. 



21. The subtitle cotorwiping decoding method of claim 
20 further comprising delay compensating a delay 
inherent in the cotorwiping decoding method such 
3t> that said frame of subtitles is displayed with said vid- 
eo image at a position indicated by said decoding 
information. 



16. The subtitle cotorwiping decoding apparatus of 
damn 1 5 wherein the cotorwiping means comprises 3S 
switching means for switching the standard color 
look up table and a cotorwiping color look up table 

at said location indicated by said decoding informa- 
tion, causing said portion of said frame encoded af- 
ter said location to have a different color than said 40 
portion of the frame encoded before said location. 

17. The subtitle cotorwiping decoding apparatus of 
daim 16 wherein the cotorwiping means further 
comprises: 4S 

latching means for latching a value indicative 
of said location represented by said decoding 
information; and 

counting means for decrementing said value as so 
^ each pixel of said video image is displayed, 
wherein said switching means switches said 
standard cotor look up table with said cotorwip- 
ing took up table when said counting means 
reaches zero ss 

18. The subtitle cotorwiping decoding apparatus of 
daim 17 further comprising subtitle decoding 



22. The subtitle cotorwiping decoding method of claim 
20 further comprising representing encoding each 
pixel of said subtitles as an address in a standard 
color took up table, said address being chosen ac- 
cording to color components of each pixel. 

23. The subtitle cotorwiping decoding method of claim 

22 wherein the step of colorwjping further compris- 
es switching the standard color took up table and a 
cotorwiping cotor took up table at said location indi- 
cated by said decoding information, thereby caus- 
ing said portion of said frame encoded after said lo- 
cation to have a different color than said portion of 
the frame encoded before said location. 

24. The subtitle cotorwiping decoding method of claim 

23 wherein the step of cotorwiping further compris- 
es: 

latching a value indicative of said location rep- 
resented by said decoding information; and 
decrementing said value as each pixel of said 
video image is displayed, 
wherein said standard color took up table is 
switched with said cotorwiping took up table 
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when said value is decremented to zero. 

25. The subtitle colorwiping decoding method of claim 

24 further comprising subtitle decoding said subtitle 
data stored in said butler. s 

26. The subtitle colorwiping decoding method of claim 

25 further comprising mixing said video data decod- 
ed by said video decoding step with said subtitle da- 
ta decoded by said subtitle decoding step. io 

27. The subtitle colorwiping decoding method of claim 
20 further comprising repeating each of said color- 
wiping decoding steps for different frames of subti- 
tles having different locations indicating where said is 
colorwiping ends. 

28. A subtitle position decoding apparatus supplied 
with multiplexed subtitle data and encoded video 
data, comprising: 20 

video decoding means for decoding the encod- 
ed video data of a video image to be displayed; 
buffer means for storing the subtitle data to be 
displayed as a frame of subtitles contempora- 2$ 
neously with said video image; 
control means for timing a read out operation 
of said subtitle data from said buffer means dur- 
ing a real time display of said video image; and 
means for dynamically changing a position in 30 
the video image where said frame of subtitles 
is superimposed during display. 

29. The subtitle position decoding apparatus of claim 

28 wherein the means for dynamically changing 35 
comprises: 

latching means for latching a value indicative 
of said position where said frame of subtitles is 
to be superimposed; and 40 
counting means for decrementing said value 
each time a pixel of said video image is dis- 
played, 

wherein said control means performs said read 
out operation when said counting means reach- 4S 
es zero, thereby causing said frame of subtitles 
to be superimposed with said video image at 
that time. 

30. The subtitle position decoding apparatus of claim so 

29 further comprising: 

delay compensation means for compensating 
a delay caused by components of the subtitle posi- 
tion decoding apparatus so as to display said frame 
of subtitles with said video image at a position indi- ss 
cated by decoding information included h said sub- 
title data 



31. The subtitle position decoding apparatus of claim 
29 further comprising subtitle decoding means for 
decoding said subtitle data stored in said buffer 
means. 

32. The subtitle position decoding apparatus of claim 
31 further comprising mixing means for mixing said 
video data decoded by said video decoding means 
with said subtitle data decoded by said subtitle de- 
coding means. 

33. A subtitle position decoding method for decoding 
subtitle data multiplexed with encoded video data 
comprising the steps of: 

video decoding the encoded video data of a vid- 
eo image to be displayed; 
storing the subtitle data in a buffer to be dis- 
played as a frame of subtitles contemporane- 
ously with said video image; 
timing a read out operation of said subtitle data 
from said buffer during a real time display of 
said video image; and 

dynamicalry changing a position in the video im- 
age where said frame of subtitles is superim- 
posed during display. 

34. The subtitle position decoding method of claim 33 
wherein the position of said frame of subtitles is dy- 
namically changed by. 

latching a value indicative of said position 
where said frame of subtitles is to be superim- 
posed; and 

decrementing said value each time a pixel of 
said video image is displayed, 
wherein said read out operation is performed 
when said value is decremented to zero, caus- 
ing said frame of subtitles to be superimposed 
with said video image at that time. 

35. The subtitle position decoding method of claim 34 
further comprising delay compensating an inherent 
delay caused of the subtitle position decoding meth- 
od. 

36. The subtitle position decoding method of claim 34 
further comprising decoding said subtitle data 
stored in said buffer. 

37. The subtitle position decoding method of claim .36 
further comprising mixing said decoded video data 
with said decoded subtitle data. 

38. The subtitle position decoding method of claim 33 
further comprising repeating said steps of vfcteo de- 
coding, storing, reading and dynamically changing 
for different frames of subtitles having different po- 
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sitions whereat the frame of subtitles is to be super- 
imposed on the video image. 
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